Scaling Properties of Random Walks on Small- World Networks 
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Using both numerical simulations and scaling arguments, we study the behavior of a random 
walker on a one-dimensional small-world network. For the properties we study, we find that the 
random walk obeys a characteristic scaling form. These properties include the average number 
of distinct sites visited by the random walker, the mean-square displacement of the walker, and 
the distribution of first-return times. The scaling form has three characteristic time regimes. At 
short times, the walker does not see the small-world shortcuts and effectively probes an ordinary 
Euclidean network in d-dimensions. At intermediate times, the properties of the walker shows 
scaling behavior characteristic of an infinite small-world network. Finally, at long times, the finite 
size of the network becomes important, and many of the properties of the walker saturate. We 
propose general analytical forms for the scaling properties in all three regimes, and show that these 
analytical forms are consistent with our numerical simulations. 

PACS numbers: 87.18.Sn, 05.10.-a, 05.40.-a, 05.50.+q 
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I. INTRODUCTION 

The topological properties of real-world networks have 
been studied extensively. But an even more intriguing 
task, and a natural extension of these studies, is to under- 
stand how the network structure affects dynamics on the 
networks. Most people have had the unfortunate expe- 
rience of catching the flu (an example of disease spread- 
ing) or picking up a burning hot plate (an example of 
neural signal transmission). These phenomena are all 
examples of dynamics on the special kind of real-world 
networks that have been found to display "small-world" 
properties. Of these phenomena, the greatest attention 
thus far has beengiven to the study of disease spreading 
[see, e. g. 0,0, ETUI]- It has even been suggested that 
the web of sexual contacts has a small-world structure 
0, ■ Other dynamical models that have been studied 
on complex networks include the Hodgkin-Huxley model 
Boolean dynamics 0, and the generic synchroniza- 
tion of oscillators Extensive reviews can be found 
in Refs. [IS El 

In this paper, we will present results for a random walk 
on a small- world network (SWN, defined below). Such 
random walks may have sever al ap plications to real sys- 
tems. For example, Scala et a/[ll| have argued that the 
conformation space of a lattice polymer has a small- world 
topology, and hence, that diffusion and random walks on 



such small-world networks might give insight into relax- 
ation processes such as protein folding. 

Much is known about random walks on both regular 
and random networks (see, e. g., 0,^3)- I* 1 addition, 
there have been several recent studies of random walks 
on SWN's [H [H HJl E E pi HH- For exam- 
ple, Jasch and B lumen |17| and Lahtinen et. al 0] have 
studied the average number of distinct sites visited by 
a walker, and the probability that the walker is at the 
origin after n steps in the limit that the network size 
L — ► 00 and, hence, the number of shortcuts x — ► 00. 
In the present work, we present results for the scaling 
behavior of such quantities as the mean-square displace- 
ment, the mean number of distinct sites covered during 
a random walk, the first-return time abd clarify the pro- 
cedure for obtaining a scaling collapse for random walks 
on SWN's. 



II. THE RANDOM WALK 
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In previous work |22|, |23| , we developed a simple prob- 
ability function approach for the topological properties 
of complex networks generated according to the small- 
world model pi. f25| . In this approach, we start from 
a one-dimensional regular network with periodic bound- 
ary conditions and L = 2N nodes, each node being 
connected to its 2k nearest neighbors. Hence, the "de- 
gree" of each node is 2k. Next, we add shortcut ends 
to each node according to a given degree distribution 
(T> q ), by following the prescription of Refs. |2o. 1271 . In 
the present work we use a modified approach [23 by 
using the following degree distribution in one dimen- 
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sion (with k = 1): V q = (1 - p)V( q )(p) + p V( q -i){p), 
where V q (X) — exp(— A) X q /ql is the Poisson distribu- 
tion. We then select pairs of shortcut ends at random 
and connect them to each other, thus creating a short- 
cut. This network-generating procedure (with the above 
T> a ) is equivalent to that outlined by Newman and Watts 
|25| . The quantity kp is the probability that a given site 
has a shortcut. On average, there will be x — kpL short- 
cuts in the network. 

We carry out the random walk on a lattice (Polya walk) 
as follows: (i) There is only one walker on the small-world 
network at a time, (ii) The random walker is injected 
onto a randomly chosen site on the small-world network, 
a new site for each walker. We will call this site the "ori- 
gin" of the walk, (iii) At each discrete time step, t, the 
walker will jump to a randomly chosen nearest neighbor 
of its current site m with probability l/k(m). Here, k(m) 
is the number of nearest neighbors of site m, i.e. the de- 
gree of node m. (iv) The random walker is allowed to 
wander the network for a time longer than the "satura- 
tion time" for the quantity studied, i.e. the time when 
that quantity approaches its limiting behavior, (v) We 
average over different random walkers and realizations of 
the small- world lattice until the results converge. 



III. SCALING BEHAVIOR 
A. General Form 

In earlier work [22, IS] , we demonstrated that the ba- 
sic probability distribution P(m\n;L,p) (the probability 
that two sites separated by n hops before the introduc- 
tion of shortcuts has a minimal separation of m hops 
when shortcuts are included) scales with x in the limit of 
p< 1, for all choices of x. As a consequence, topological 
quantities derived from P(m\n; L,p) displays a scaling 
with x = pL in the same limit. 

We will first state our main result for the scaling of 
the random walk in general, and then consider specific 
examples. Let 0(p,L,i) be some measurable quantity 
for the random walk on an SWN, which saturates to a 
finite value O sa t as t — > oo. As specific examples, we will 
discuss the mean-square displacement and the average 
number of sites covered by the random walker in time t. 
We propose that 0(p,L,t) satisfies the scaling law: 

0(p,L,t) = O sat T{p\pL). (1) 

We have numerically confirmed this scaling Ansatz, as 
described in the rest of this paper. According to Eq. QJ, 
a scaling collapse is observed if one plots the quantity of 
interest for various choices of the variables (p, L), holding 
x = pL = const., for any choice of x. This behavior is 
in contrast to previous statements that a scaling collapse 
cannot be expected when x 100 (Isf. Note also that 
the scaling collapse is seen only for fixed values of x = pL 
and that a prerequisite for scaling is that p <C 1 • Previous 




FIG. 1: This figure shows the scaling collapse for Ncov, the 
average number of distinct sites visited by the random walker, 
for x — pL = 10 (circles, system sizes L — 10 4 and L = 10 5 ); 
x = 100 (squares, L = 10 4 and 2.5 x 10 4 ; and x = 1000 
(asterisks, L = 10 5 and L = 2.5 x 10 s ). The scaling collapse 
is very good. 

workers \vA ITsI ] have attempted to show scaling collapse 
for fixed values of L (or p) while varying p (or L), and 
did not obtain a perfect scaling collapse. By contrast, our 
present results display a perfect scaling collapse for fixed 
values of x. In the following, we present our numerical 
results for two quantities: the mean number of distinct 
sites covered, Ncov, ancl the- mean square displacement, 
(r 2 ). 

B. Average Number of Distinct Visited Sites 

The average number of distinct nodes visited by a ran- 
dom walker, denoted Nqov, was first studied by Dvoret- 
zky and Erdos |29| for a random walker on an infinite d- 
dimensional regular lattice. They found that iVcov ~ vt 
in 1-d, Ncov ~ i/lnt in 2-d and iVcov ~ t for d > 2, in 
the limit of t — > oo. How does the small- world network 
modify this result? Following the arguments of [l^, we 
expect that for short times, t -C £ 2 (with £ = 1/p), the 
random walker will be probing regions of the small-world 
network that are essentially without shortcuts (linear re- 
gions). Hence, the behavior should be similar to the p = 
case where the walker covers iVcov ~ Vt sites. For long 
times, t 3> L£, we expect all the sites in the network 
to be covered and A^cov = L. For intermediate times, 
( 2 <(<C L£, the walker spends on the average £ 2 time 
steps per linear region, before a new region is accessed 
- the shortcuts act like a kind of branching process for 
the random walk. As a consequence, in this time re gim e 
there should be i/£ 2 segments covered and iVcov ~ t |17j . 
Combining these regimes, we obtain the scaling form 

N cov = L S(t/e;x), (2) 



3 



10° r 

10' f 

10 4 f 

10 - 

10 2 - 

10 1 r 
10° 



Slope 1 



Slope 1/2 





- L=10 3 


X 


^L=10 4 




^)L=10 5 




-^L=10° 



10 10 10 10 10 10 10 10 10 
time t 




FIG. 2: Effects of finite size on the average number of covered 
sites, Ncov, which is plotted as a function of time t at fixed 
density of shortcuts p = 0.01, for four different system sizes: 
L — 10 3 , 10 4 , 10 s and 10 6 . The saturation seen at all four 
values of L is a finite-size effect. 



where 



y/y/x, y < 1, 
S(y;x) ~ { y/x, 1< y < x, 
1, y>x, 



(3) 



and y = i/£ 2 . This is the expected finite-size scaling 
form for the average number of distinct visited nodes in 
the small-world model in the limit x > 1. 

In Fig. ^ we show a plot of our calculated iVcov for 
x = 10 (circles), 10 2 (squares) and 10 3 (stars). For each 
value of a;, we have used different values of p, ranging 
from p = 0.0002 to p — 0.01, two for each x-value. The 
scaling collapse is excellent. These results suggest that 
the scaling properties of the small-world network deter- 
mine the scaling of the random walk; hence, to find a 
scaling collapse, one must keep the average number of 
shortcuts, x, constant. This Figure also shows that, as x 
increases, Ncov deviates more and more from the p = 
result. 

If, instead, we hold the density of shortcuts constant 
and vary the system size, we can explore the finite-size 
effects on the average number of covered sites, N C ov- In 
Fig. [3 we plot the succession of curves L = 10 3 , 10 4 , 10 5 
and 10 6 , all with p = 0.01. Upon examination, we find 
that the slope of the resulting scaling curve changes from 
1/2 to 1. That is, for small t (t < £ 2 ), N CO v ~ ^ af- 
ter which, at larger t, there is a crossover to Ncov ~ t, 
and finally, at even larger t, finite-size effects become ap- 
parent. This behavior observed in the simulations agrees 
very well with the arguments preceding Eq. @. Note 
that, when £ < L, we do not see a crossover to the linear 
regime in which Ncov ~ t before finite size effects start 
to become dominant. 

We now derive an approximate expression for Ncov 
which is consistent with Eq. © and also in good agree- 



FIG. 3: Comparison of the approximation (stars) to Ncov, 
Eq. with numerical data (solid line) for L — 10 5 and p = 
0.01. The asymptotic [L — > oo) curve (dotted line) satisfies 
A^cov oc yfi for small t {t ^ 2 = 1/p 2 ) and iVcov oc t for large 
t (i > ( 2 ). The change of slope between the two behaviors 
occurs near t ~ £ 2 . 



ment with the large-x simulation results. We note that, 
on average, there are 2x shortcut ends in the network, 
defining 2x contiguous "regions" in the l-d network. If 
a walker takes a shortcut (or "jump"), it transports the 
walker from one region to another, randomly chosen, re- 
gion in the network. When the number of jumps rij is 
small compared to 2a;, there is a high probability that the 
regions visited by the walker are "distinct" (as defined 
more precisely below). However, when rij ~ 2a:, there is 
a high probability that some regions will be visited more 
than once. These multiple visits lead to saturation effects 
since the already-visited sites do not contribute to Ncov- 
We now derive an expression for the mean number of 
distinct regions visited by the walker in rij jumps. Be- 
cause each jump transports the walker from one region to 
another, randomly chosen region, the number of distinct 
regions is obtained by solving the following problem: If 
rij integers are chosen independently and randomly from 
the set {1,2, 2x}, what is the mean number of distinct 
integers chosen? This latter problem is easily solved: The 
probability that a given integer is not chosen in a given 
trial is q = 1 — hence, the probability that a given in- 
teger is not chosen in rij trials is q nj w e ~ n i/( 2x ) (where 
we have assumed x 3> 1). Thus, the mean number of 
distinct integers chosen after rij trials is 



'cov 



= 2a; 



(4) 



For the original problem, the above expression gives us 
the number of distinct regions visited by the walker after 
rij jumps, and each distinct region visited by the walker 
corresponds to covering L/(2x) sites. Furthermore, after 
time t, the random walker has, on average, taken rij = 
[4:p 2 t\ jumps. Hence, the probability that the walker 
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FIG. 4: Mean-square displacement, (r 2 (t)}, for a random 
walker on an SWN for several values of p < 0.01 and the 
three choices for average numbers of shortcuts: x — pL = 10, 
10 3 and 10 5 . Note that each constant-a; curve consists of two 
distinct (p,L) combinations. (r 2 (t)) saturates at large t be- 
cause of finite-size effects. 

visits a new region after the jump is cxp(—[2y\/x). 
Also, the time spent by the walker in this new region is 
t' = t — ^2 |_4p 2 £j , while the number of sites covered in 

this time interval is given by y¥, i.e. is proportional 
to the expression for the p — case. Combining these 
estimates, we find that the mean number of sites visited 
after time t is given by 

S(y,x) « 1-e-SW + -v^^Je-fbJ ( 5 ) 

x 

Expression JSJ is clearly only an approximation to the 
exact function S(y,x). However, it does captures the 
key processes leading to the growth and saturation of 
Nqov and hence is a useful approximation. In Fig. |3 we 
compare this function to the numerically obtained curves 
for S(y,x) at p = 0.01, taking L = 10 5 and L — > oo. 
The agreement is quite good and shows that Eq. is a 
reasonable approximation to the scaling function. 

C. Mean-Square Displacement 

We now compute the mean-square displacement, 
(r 2 (t)), of the random walker as a function of time t. 
To calculate this quantity, we first, at each time step, 
find the minimal distance from the current position of 
the random walker to the origin (i.e. the smallest num- 
ber of steps needed for the random walker to reach the 
origin) using a breadth-first search method. Then we al- 
low the walker to move through the network until (r 2 (t)} 
has saturated. Finally, we average over different initial 
positions of the walker and realizations of the network. 

Now, we know that for a random walk on an infinite, 
hypercubic, <i-dimensional lattice (r 2 (t)) = (1/2) D t, 



FIG. 5: Mean-square displacement, (r 2 (t)), as a function of 
time t for a random walker on a succession of networks, all 
with the same density of shortcuts (p = 0.01), and system 
sizes varying from L — 10 3 to L = 10 7 . Except for very large 
t, all curves collapse onto a single scaling curve, the curve 
which would be obtained for L — > oo, but at sufficiently large 
t, finite-size effects become important. 



as can be shown using e.g. a generating function formal- 
ism ^j|,[28|. However, on a finite lattice, (r 2 (t)), must 
approach a constant for large t. In this limit, each node 
of the network has equal probability of being occupied 
by the random walker. This insight immediately gives 
(r 2 ) = £ 2 , where I 2 is the squared minimum distance be- 
tween a pair of nodes, averaged over all possible pairs 
and network realizations. 

On an SWN, the other relevant length scale for the 
random walker is £ = 1 /p, the average distance the walker 
travels to reach a shortcut. These two lengths suggest 
the following scaling Ansatz: (r 2 ) = I 2 R(t/£ 2 ;pL). 
We can also infer the behavior of R(y, x) using simple 
arguments. For times t <C £ 2 , the walker is exploring 
regions of the network without shortcuts, and we expect 
diffusive behavior similar to that of a regular network, 

giving R(y,x) ~ y/i 2 - When t ~ \Zp/p, we expect the 
mean-square displacement to saturate, and R{y,x) = 1. 
The transition between the two types of behavior is not 
sharp, since the walker may reach a shortcut before it 
has travelled a distance £. 

We have numerically confirmed this scaling collapse for 
a wide range of x values. In Fig.0J we plot R(t/^ 2 \ x) for 
a sequence of networks with x = pL = 10, 10 3 and 10 5 . 
For each constant-x curve, we show use two distinct val- 
ues of p < 0.01. We see that initially, the walker probes 
a regular network, and R(t/^ 2 ;x) is linear in t. When 
t/£ 2 ~ 1, the walker begins to reach some shortcuts in 
the network, and there is a crossover to superdiffusive 
behavior. Finally, at still larger t/t; 2 , finite-size effects 
become important and R(t/^ 2 ;x) saturates. 

To further explore finite-size effects on the mean- 



5 




time t 



FIG. 6: Comparison of the approximation (stars) to (r 2 (t)}, 
Eq. ©, with numerical data (solid line) for L — 10 7 and p = 
0.01. The asymptotic (L — > oo) curve (dotted line) satisfies 
(r 2 (t)} oc t for small t (t < £ 2 ) and {r 2 (t)} oc t 2 for large t 
(t » C 2 )- 

square displacement, we have studied (r 2 (t)) in a suc- 
cession of networks, each with the same density of short- 
cuts, p = 0.01, but with different linear size L. In Fig. 
03 we plot the calculated (r 2 (t)) for values of L differing 
by factors of 10 and ranging from 10 3 to 10 7 . The re- 
sulting curves are all very similar to the L — > oo curve, 
until finite size effects produce saturation with (r 2 ) = £ 2 . 
Only for the largest s-values are we able to reach the su- 
perdiffusive regime, and even for x = 10 5 , this regime is 
so narrow that we cannot with confidence determine the 
exponent of the expected power-law time dependence. 

The development of an approximate analytical expres- 
sion for (r 2 (t)) is difficult, since we need the minimal 
distance between two lattice points. However, we know 
the limiting forms for (r 2 (t)). Further, by making the ap- 
proximation that the random walker only uses a short-cut 
once, we can extend the arguments used to derive the ap- 
proximate expression for iVcov, Eq. (J5J. Hence, we can 
write down the following ansatz for (r 2 (t)}: 

R(*,x) = l-e~^ M ' (i-^=(y-LyJ)). (6) 

In Fig. we compare this ansatz with the simulations 
for L = 10 7 ; evidently it agrees reasonably well with the 
numerical results. 

We can write down the scaling function in several lim- 
iting regimes, without necessarily using the above ansatz 
for the specific functional form. For example, we must 
have 

R(y;x)~y/(p 2 P), y «l, (7) 

and 

R(y;x) = l, y^pVt^. (8) 




t/</ 2 (L,p)> 

FIG. 7: Scaling collapse of the first-return time distribution, 
/(0,t) plotted against the dimensionless time u = t/£ 2 (L,p) 
for networks with the average number of shortcuts x — pL = 
100 using L = 10 4 and 1 = 2.5 x 10 4 nodes. 

However, the known limiting behaviors cannot give the 
scaling function in the intermediate regime. We therefore 
use the above ansatz to propose 

R(y; x) ~ y 2 /(p 2 ¥), 1 « y « P V¥. (9) 

We are not able to verify this last behavior numerically 
from our present results. 

D. First Return Time Distribution 

Next, we turn to another property of a walker on an 
SWN, namely the distribution of first passage (or first re- 
turn) times. This is the probability that a walker will re- 
turn to a given site m for the first time a time t after leav- 
ing that site. We denote this distribution f(m,t;L,p). 
Note, that this distribution does not saturate to a finite 
value when t — > oo, and hence, it shows that the scaling 
collapse of random walk properties is not only limited to 
those which saturate to a finite value. In order to find a 
smooth distribution, we must make a slight change to the 
random walker rules: For each time-step, the walker is 
now allowed to stay on the current node with probability 
l/(fc(m) + 1). 

An extensive review of first passage processes has been 
given by Redner [3l| . Unlike the other quantities pre- 
sented in this article, the first-return time does not sat- 
urate to a finite value, instead it approaches zero. How- 
ever, the scaling collapse is still present. This collapse 
is demonstrated in Fig. [7] where we plot /(0,i) for two 
different (p, L) combinations, holding x constant. 

The "small-world" effect on the first-return time dis- 
tribution is most clearly seen at large values of x. In Fig. 
03 we plot /(0, t) for a network of L = 10 6 sites and a 
shortcut density of p — 0.01. For short waiting times, as 
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u=t/<f(L,p)> 

FIG. 8: First-return time distribution, f(0,t), plotted against 
the dimensionless time u — t/£ 2 (L,p). For waiting times 
t >C i 2 (L,p), the first-return time distribution /(0, i) behaves 
like that of a p = network, with f(0,t) ~ t~ 3/2 . For inter- 
mediate waiting times (£ 2 (L,p) < i < Lf), /(0, t) is indepen- 
dent of t, since each node is occupied with equal probability. 
For t > L£, lattice finite-size effects dominate. The inset 
shows (t/P) 3/2 /(0,t/^). 

expected, /(0, f) behaves like that of a p — network (no 
shortcuts). However, for intermediate waiting times such 
that £ 2 <C t <C L£, we find that /(0,t) is independent of 
i. This independence indicates that the position of the 
random walker is completely randomized: the memory 
of the walker's starting position is no longer retained in 
the system and the walker is equally likely to occupy any 
site in the network. This occurs when t ~ £ 2 , as dis- 
cussed above for (r 2 (t)}. Also, L£ is the characteristic 
time for the asymptotic decay of /(to, t; L,p), since it is 
the saturation timescale for A*cov- Note that the separa- 
tion of £ 2 {L,p) and L£ increases with increasing number 
of shortcuts x in the system, making the "knee" of the 
first-return distribution more pronounced. 

For a random walk on a finite interval [0,L] with an 



absorbing wall at zero and a reflecting wall at L there is 
a similar effect in the first return time |3lll3^ : at t ~ L 2 
there is an enhancement of the first return probability. 
In our case, the origin of this effect is the splitting of 
the timescales £ 2 and L£, while for the walk on the finite 
interval the cause for this effect are the contributions 
from reflected trajectories. 



IV. SUMMARY 

In summary, we have studied the behavior of a random 
walker on a small-world network, using a combination of 
numerical methods and scaling assumptions. We conjec- 
ture that the scaling law of Eq. (JTJ is obeyed by measur- 
able, saturating properties 0{p,L, t) of a random walk on 
an SWN. Among these properties are the average num- 
ber of distinct visited sites, Nqov, and the mean-square 
displacement (r 2 ) for random walks on SWN's, both of 
which we have studied over a wide range of node num- 
bers L and shortcut densities p. In both cases, we find 
that Eq. (JTJ is satisfied, and the quantities depend only 
on the single variable x = pL. Additionally, we find that 
non-saturating properties also show a scaling collapse, as 
exemplified by the first-return time. 

Thus, we have shown that the dynamical behavior of a 
random walker on an SWN has the same scaling behav- 
ior as that exhibited by purely geometrical properties of 
the network (as described in e.g. Ref. H^)- This scal- 
ing behavior should be useful in interpreting a variety 
of other properties on SWN's, and may be of value in 
studying real-world phenomena for which an SWN is a 
good model. 
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